(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
31 January 2002 (31.01.2002) 




PCT 



(10) International Publication Number 

WO 02/09307 Al 



(51) International Patent Classification 7 : H04B 3/30, 

H04J 3/24, H04L 12/56, 12/66 

(21) International Application Number: PCT/US0 1/1 6735 

(22) International Filing Date: 23 May 2001 (23.05.2001) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

09/625, 747 



26 July 2000 (26.07.2000) US 



(71) Applicant: PLURIS, INC. [US/US]; 10455 Bandley 
Drive, Cupertino, CA 95014 (US). 

(72) Inventors: SKIRMONT, David; 417 H Cork Harbour 
Circle, Redwood City, CA 94065 (US). AGARWAL, 
Puneet; 50 Chumasero Drive, 10M, San Francisco, CA 
94132 (US). TUCK, Russ; 1136 S. Banley Avenue, San 
Jose, CA 95129 (US). 



(74) Agent: BOYDS, Donald, R.; P.O. Box 187, Aromas, CA 
95004 (US). 

(81) Designated States (national)'. AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, 
SL, TJ, TM, TR, TT, TZ, UA, UG, UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— with international search report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: METHOD AND APPARATUS FOR LOAD APPORTIONMENT AMONG PHYSICAL INTERFACES IN DATA 
ROUTERS 



33 



35 



37 



39 



< 

m 
as 





CONSULT 
FORWARDING 
TABLE 




HASH S and D: 

CRC(S,D) = 
10-BIT NUMBER 




ROUTE TO INTERFACES 
ACCORDING TO 
UNIQUE BITS 


S-2221 

D=im 













IFX 



xxxxxxxxxx 



xxxxxxxxxx 



MAP 



(57) Abstract: A method for routing a packet (pi) received in a packet router (39) is taught, the method comprising the steps of 
^ selecting a logical interface (ifx) having multiple physical ports as a destination for the packet (pi), processing any one or more 
£J addresses or labels of the packet and other packets received by a common function, producing thereby results unique to the packets 
in which the addresses and labels processed differ, (c) mapping (39) the physical ports at the destination to the unique results produced 
^ by processing the addresses or labels of packets, and (d) routing the data packet according to the mapping. Weighting is applied to 
^ physical ports in the mapping, the weighting reflecting different transmission capacities of the ports. Apparatus for practicing the 
^ invention is taught as well. 



WO 02/09307 



PCT/US01/16735 



Method and Apparatus for 
Load Apportionment Among Physical Interfaces in Data Routers 



Field of the Invention 

The present invention is in the area of hardware and software for data packet 
routers, and pertains more particularly to methods for ensuring common physical 
routing for, in particular, IP packets, and for load balancing in packet routing among 
physical interfaces. 

Cross-reference to Related Documents 

The present application is related to co-pending US patent application S/N 
09/594,300 filed on 6/14/2000, which is titled "Method and Apparatus for Mapping 
Data Packets Between Lines of Differing Capacity at a Router Interface", the 
disclosure of which is incorporated by reference. 

Background of the Invention 

The growth and development of the public network known as the Internet is a 
very well-known phenomenon. The Internet has grown very rapidly both in terms of 
end users and content providers. This phenomenal growth has generated a great need 
for improved hardware and software for handling the greatly increased data traffic. 

Hardware-software systems known as routers are the workhorses of the 
Internet. In current art most routers are capable of handling traffic at rates in the 
gigabit per second range. The present inventors are engaged in developing Terrabit 
routers, and in proposing and developing solutions for problems inherent in current art 
routing systems. 

As is well-known in the art, there are several different kinds of packets to be 
routed in Internet traffic. One type of packet is termed in the art an IP packet. IP 
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packets can be used for all-types of data; including Internet telephony and Internet 
video streaming. IP packets have header fields defining such as the source and 
destination for each packet. 

In the art of packet routing it is well-known that it is desirable for packets to 
5 arrive at a destination in the same order that they were generated at a source. For one 
reason, out-of-order packets may well cause dropouts in applications such as voice 
and video communication and the like. Provision may well be made at a destination 
to re-order packets, but such re-ordering is expensive in processor resources. Such 
provision is commonly not made, and packets may be lost or discarded in any case. 

If there were to be only one hop from a source to a destination, this would not 
be problem. Since there are invariably several machines through which packets must 
pass and be processed, and because newer and better routers may employ processing 
parallelism, attention must be paid to the order of packets. 

The packets handled by a router can be logically divided into flows, where 
each flow is the set of all packets which are being sent from the same origin to the 
same destination. A group of such flows can be treated as a single flow. Generally 
speaking, if packets in the same flow are always sent from every system in the order 
that they were received, the original ordering will be honored. This is therefore an 
object of the present invention. 

Another problem related to the problem of IP packets is a problem of load 
balancing among multiple physical interfaces. As the number of physical interfaces 
associated with a router as opposed to the number of virtual, or defined interfaces 
becomes ever larger the problem of mapping, and IP packets by common routes 
becomes more difficult, and the problem of efficiently using the capacity of all the 
physical interfaces grows as well. 

In current art when a packet is received at a router the packets headers are read 
and typically a forwarding table is consulted to determine the next hop for the packet. 
This next hop table contains, among other things, the identity of the egress interface to 
be used and how to send the packet internally to that location. A problem in current 
art is that the egress interface may well be a defined interface comprising several 
actual physical egress ports. The problem then is one of determining which of the 
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actual physical egress ports to use. One solution is to simply do another software 
table lookup. This is not difficult for software based routing elements, but is less than 

ideal for a high-speed hardware based solution where memory space and ASIC pins 

may well be limited. 

What is clearly needed for the new generation of very high-speed and more 
sophisticated routers is a method and system for mapping IP packets that have 
common source and destination by strict physical paths, while at the same time 
accomplishing efficient load balancing along the same physical paths. 

Summary of the Invention 

In a preferred embodiment of the invention a method for routing packets in a 
router to egress ports is provided, the method comprising the steps of (a) using a 
common characteristic of each packet, choosing a set of egress ports from a table of 
sets of ports associated with said characteristic; (b) processing any one or more 
addresses or labels of each packet using a common function, producing thereby a 
numerical processing result for each packet processed; and (c) using all or a portion of 
the numerical processing result to select a single egress port for each packet from 
among the egress ports of the set chosen in step (a). 

In some preferred embodiments, in step (a), the common characteristic used 
for a packet to select a set of egress ports is a destination address for the packet, and 
in some embodiments the result of step (a) is a pointer to a first address of a sequence 
of addresses in a stored table wherein the set of egress ports is listed. Also in some 
embodiments the result of step (b) is an offset, which is added, in step (c), to the 
address of the pointer to select a single egress port. In some preferred embodiments 
the addresses or labels processed in step (b) are a source/destination address pair, 
ensuring thereby that packets of common flow egress by a common egress port. 

In some embodiments the common function by which addresses or labels of 
packets are processed is a hashing function, and some of these embodiments the 
hashing function result is a binary string, and a default subset of the binary string is 
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used to select an egress port in step (c). 

Also in some embodiments, in step (c), weighting is applied to egress ports 
based on different transmission capacities of the ports, such that packets having 
different processing results in step (b) may none-the-less be routed to a single, 
higher-capacity port, providing thereby load-balancing between egress ports. In some 
other embodiments the data packets are MPLS packets, and in step (b), the processing 
is accomplished on one or more labels in the label stack of individual ones of the 
MPLS packets. In some cases individual ones of the egress ports have different 
transmission capacity, and the transmission capacity of a port having the lowest 
transmission capacity is considered a least denominator, then ports having higher 
transmission capacity than the least denominator are assigned a whole number 
multiplier according to a capacity ratio, and the multipliers are used in the routing to 
ensure that ports having higher capacity are fully utilized. 

In another aspect of the invention a packet router is provided, comprising 
ingress and egress ports; and control circuitry for processing and routing packets. The 
router is characterized in that the control circuitry uses a common characteristic of 
each packet to choose a set of egress ports from a table of sets of ports associated with 
said characteristic, processes one or more addresses or labels of each packet using a 
common function, producing thereby a numerical processing result for each packet 
processed, and uses all or a portion of the numerical processing result to select a 
single egress port for each packet from among the egress ports of the set chosen. 

In some preferred router embodiments the common characteristic used for a 
packet to select a set of egress ports is a destination address for the packet, and in 
some of these embodiments the result of table lookup is a pointer to a first address of 
a sequence of addresses in a stored table wherein the set of egress ports is listed. In 
these cases the processing by a common function produces an offset, which is added 
to the first address to select a single egress port. 

In some embodiments the addresses or labels processed are a 
source/destination address pair, ensuring thereby that packets of common flow egress 
by a common egress port. In some of these embodiments the common function by 
which addresses or labels of packets are processed is a hashing function. The hashing 
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function result may be a binary string, and a default subset of the binary string is used 
to select an egress port. 

In some embodiments weighting is applied to egress ports based on different 
5 transmission capacities of the ports, such that packets having different processing 
results may none-the-less be routed to a single, higher-capacity port, providing 
thereby load-balancing between egress ports. In some other embodiments the data 
packets are MPLS packets, and the processing is accomplished on one or more labels 
in the label stack of individual ones of the MPLS packets. In some cases individual 

10 ones of the egress ports may have different transmission capacity, so the transmission 
capacity of a port having the lowest transmission capacity is considered a least 
denominator, ports having higher transmission capacity than the least denominator are 
assigned a whole number multiplier according to a capacity ratio, and the multipliers 
are used in the routing to ensure that ports having higher capacity are fully utilized. 

15 In yet another aspect of the invention a method for routing packets in a packet 

router having a plurality of candidate egress ports for individual ones of the packets is 
provided, comprising steps of (a) mapping sets of candidate egress ports to a common 
characteristic of individual packets; (b) mapping individual ports in each set to a 
result of processing one or more addresses or labels of individual ones of packets to 

20 be routed by a common function; (c) selecting a set of candidate ports for each packet 
to be routed by consulting the common characteristic; and (d) selecting a single egress 
port from the selected set by the result of the processing by a common function the 
one or more addresses or labels of each packet. 

In embodiments of the invention described in enabling detail below as 

25 examples, for the first time a system for routing packets among individual ones of sets 
of egress ports is provided, assuring that packet flows follow common paths and loads 
are balanced among the ports. 



30 
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Brief Description of the Drawing Figures 
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Fig. 1 is a block diagram illustrating packet processing in an embodiment of 
the present invention. 

5 Fig. 2 is a logic flow diagram illustrating packet transfer steps in the prior art. 

Fig. 3 is a flow diagram illustrating packet processing in an embodiment of the 
present invention. 

Fig. 4 is a block diagram showing a configuration in an embodiment of the 
present invention. 

10 Fig. 5 is a block diagram showing another configuration in an embodiment of 

the present invention. 

Fig. 6 is a schematic diagram illustrating practice of the present invention in a 
preferred embodiment. 

15 

Description of the Preferred Embodiments 

Fig. 1 is provided as an aid for describing the preferred embodiment of the 
present invention. In Fig. 1 a first router 1 1 is illustrated as having two logical 

20 interfaces. A first interface 13, labeled IF1 is considered as receiving data packets 
which will be processed and sent to an egress interface 15, labeled IF2. Incoming 
packets 17 are illustrated as each having a source and a destination header field 
(address). These are packets labeled PI through Pn. Notice that in the illustration all 
of the packets represented have the same source address. Two of the packets have the 

25 same destination address, and one of the packets has a different destination address. 
All packets are shown as arriving at interface one of router Rl, although there will 
typically be many more than one ingress interface. The same is true of egress 
interface IF2. That is, there will typically be many more than one egress interface, 
and most interfaces will act in both capacities. The internal interconnections and 

30 control functions managing these interconnections, known in the art as the internal 
fabric, is not shown. The simple schematic shown, however, is adequate for 
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describing this embodiment of the present invention. 

A second router 19, labeled R2, is shown as connected by four lines between 
an interface 21, labeled EF3, to interface IF2 at router one. In this example it is 
assumed that all packets received at IF1 will be routed on first hop to interface IF2 
5 for egress. In some typical cases interface IF2 is a line card having four physical 
ports. It is not required, however, that a logical interface be limited to a single line 
card. In this particular example there are four physical ports associated with interface 
IF2, but these ports are on two cards C-l and C2. The four lines between IF2 on 
router Rl and IF3 on router two are labeled card 1, line 0; card 1, line 1 ; card 2, line 
10 0; and card 2, line 1. 

It will be apparent to the skilled artisan that IP packets having a source and a 
destination address are not the only packets that will typically be received and 
forwarded by a router such as router Rl . There may also be other packets, such as 
MPLS packets having labels rather than source and destination addresses, and such 
15 packets may also be routed in embodiments of the present invention, and this 

operation will also be described below. Routing of TP packets, however, is sufficient 
to describe practice of the present invention in this preferred embodiment. 

Fig. 2 is a simplified flow diagram showing a first packet 23 being conducted 
to a physical egress port according to current art. Firstly, the system of router Rl 
20 notes the destination address, and consults a forwarding table. The forwarding table 
may have a number of logical destinations suitable for the destination address of this 
first packet A process termed "longest prefix match" is typically used to select the 
most suitable first hop destination. In this case the table lookup indicates a first top 
destination for interface IF2. At step 27 the system of router Rl sends the packet to 
25 interface IF2. At this point the question of the correct physical egress port is still 
unanswered. One solution in the prior art is to do a second table lookup from a 
specialized table which relates to all of the physical ports associated with interface 
DF2. This operation is shown as step 29. As a result of the second lookup the packet 
is sent to the finally selected physical port. 
30 The process described above with the aid of Fig. 2 is software intensive, and is 

not a good solution for new, high-speed, routers. The present inventors propose and 
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teach herein apparatus and method for routing such packets directly to physical egress 
ports in a manner that assures a rigid physical path for IP packets having a common 
source and destination address, and which are therefore part of the same flow. The 
apparatus and method of the invention also accomplishes efficient load balancing. 
5 Fig. 3 is a simplified flow diagram illustrating routing directly to physical 

interfaces according to a preferred embodiment of the present invention. An arriving 
packet, in this case packet PI, is shown at step 33. At step 35 the destination address 
is used in conjunction with the forwarding table to determine the logical interface for 
the first hop, as in the prior art example above. The result in this case the shown as 

10 IFx. Now the system of the invention, at step 37, performs a hashing function using 
both the source and the destination addresses. There are in the art a number of 
functions that might be used. One such function is known in the art as a CRC 
function. In this example a CRC- 10 function, CRC meaning cyclic redundancy 
check, is used with both the source and destination address to produce a unique 10 bit 

15 number. The unique 10 bit number is shown as a string of x's below step 37. As the 
physical mapping of physical ports to logical ports is known, at this point the system 
knows the number and identification of the physical ports associated with the logical 
port determined by the forwarding table lookup at step 35. For the present example 
these are the four ports shown for DF2 and Fig. 1 . For four ports only two bits of the 

20 unique 10 bit number from step 37 are needed. In this example the least significant 
two bits are used. This is a convenience, as any two bits could be used. One physical 
port is associated with each combination of the two selected bits, and the packet is 
sent to the physical port associated by the two selected bits. 

It will be apparent to the skilled artisan that the system described with 

25 reference to Fig. 3 could map a great number of physical ports to each logical 
interface. It will also be apparent that every packet having the same source and 
destination address pair will be sent to exactly the same physical egress port. 
Reordering problems due to common packets taking variant physical paths are now 
completely eliminated. Assuming also that the physical ports each have the same 

30 transmission capacity, efficient load balancing is also accomplished. These 

assumptions are particularly convenient for one situation well-known to the present 
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inventors. This is a situation where the logical interface may be a line card having 
four physical ports, with each port having the same transmission capability. In this 
situation the physical port mapping may be conveniently implemented largely in 
hardware on the line card. 
5 There are, of course, situations wherein physical ports mapped to logical 

interfaces will not each have the same transmission capacity. The simple solution in 
this case is to provide more bits in the result of the hashing function for those physical 
ports that have higher capacity. For example, in a case of a logical interface having 
four physical ports, three of which are 2.5 gigabit ports, and one of which is a 10 

1 0 gigabit port, one would need seven unique mappings. One would therefore need to 
use three bits of the 10 bit hashing result (capable of identifying up to eight unique 
mappings) to map packets among the four ports. One unique combination of the three 
bits would be assigned to each of the 2.5 gigabit ports, and four unique combinations 
of the three bits would be assigned to the 10 gigabit port. One might make an analogy 

1 5 of buckets into which packets are dumped according to the processing of this 

embodiment of the invention. In this case there are seven 2.5 gigabit buckets, four of 
which are assigned to the 1 0 gigabit port, and one bucket is assigned to each of the 2.5 
gigabit ports. The result is still that DP packets with unique source/destination address 
pairs are routed by unique physical paths, and efficient load balancing is still 

20 accomplished. 

In this example of four bits and seven destinations, there is a bit pattern left 
over, and, since the destination is selected by the result of the hashing function in the 
four bits, there needs to be a destination for the eighth bit combination (every packet 
has to have a destination). In this case a good choice is to map the eighth combination 

25 to the 10.0 gigabit port (which now has five bit combinations), to provide a good 
approximation for load balancing. 

There are alternatively a number of ways the mapping may be done. In the 
case where the number of choices is a power of 2, the binary bits solution works very 
well. If there are fewer choices than the number of bit combinations, then the 

30 otherwise unused combinations need to be mapped to redundant destinations, as was 
described above for four bits (eight combinations) and seven physical destinations. 
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For better approximation, one may use additional bit(s) and assign the right fraction of 
their values to each port. 

In an alternative embodiment a mathematical division is required, where the 
hash value is divided by the number of choices (already weighted as shown above to 
5 reflect ratio of speeds) and the remainder is used to select a choice. This gives a more 
precise allocation of packets. In yet another embodiment there may be some other 
approximation of division, using any approximation of division or remainder known 
in the art. 

In another aspect of the invention, shown schematically in Fig. 4, there may be 

10 a choice to be made between two logical interfaces at the same router, and the two or 
more interfaces may connect to the same or two different downstream routers. In Fig. 
4 a first router 41 as a logical interface IF1 receiving packets and two egress 
interfaces IF2 and IF3 are shown. IF2 connects by four lines to IF4 at a second router 
43, and each of these lines has 82.5 gigabit transmission capacity. IF3 connects by a 

15 single 10 gigabit capacity line to a third router 45 at interface IF5. 

In this example the forwarding table regards IF2 and IF3 as exactly equal, and 
the longest prefix match returns both IF2 and IF3. The solution in this case is similar 
to the solution described above for one logical interface having physical ports of 
differing capacity. It is necessary in this case to accomplish the hashing operation 

20 prior to packets reaching the egress interfaces. In this case the solution requires eight 
buckets, which can be accomplished by three bits of the unique 10 bit hashing result. 
Four buckets are assigned to IF3, and four more buckets, one each to the four physical 
ports associated with IF2. This is a solution applicable to equal cost routing. 
In a situation involving non-equal cost routing, a shown in Fig. 5, 

25 embodiments of the present invention are still applicable, and still provide latency 
solution and load balancing. In Fig. 5 a first router 47 has in ingress interface DFl and 
two egress interfaces IF2 and IF3. IF2 connects by a 7.5 gigabit line to an interface 
EF4 at a second router 49. IF3 connects by a 2.5 gigabit line to a third router 5 1 . The 
solution in this case requires four buckets representing 2.5 gigabit capacity each. 

30 Three of the buckets are dedicated to the 7.5 gigabit line between routers 47 and 49, 
and one bucket is dedicated to the 2.5 gigabit line between router 47 and router 51 . 
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The latency solution and load balancing solution are still intact. 

There are a wide variety of arrangements of hardware and software that may 
be used in practice of the present invention, which is useful to select a physical port 
among a plurality of physical ports to which a packet may be routed in a router. Fig. 
6 is a schematic diagram illustrating practice of the invention in one preferred 
embodiment. In this example an incoming packet 53 triggers a routing process, as is 
common in any router. Element 55 in this diagram represents a route lookup. In 
conventional routers this lookup determines the final destination for an incoming 
packet. 

In routers under development at the time of the present patent application by 
the present inventors and others, a route lookup as represented by element 55 in Fig. 6 
may be used to select a set of potential destinations for a packet in process, rather than 
a single destination. There may be, for example, several physical ports to which a 
packet may be sent, all more-or-less equivalent. The route lookup is typically done by 
a mapping of final destination address for a packet to an updated route table, which 
associates internal egress ports with final destinations. 

In this example potential egress ports are represented in a route parameter 
table, and the lookup at 55 produces a pointer 61 to a first port in a set 65 of potential 
egress ports. Set 65 of potential egress ports in table 63 is but one of a plurality of 
such sets listed sequentially in the parameter table. By default, the lookup 55 
produces a pointer to the first one of the ports in the set. 

In the processing of incoming packet 53, certain addresses or labels, typically 
accompanying the packet as header fields, are, in a preferred embodiment of the 
invention, acted upon by a common function shown as F(x) in element 57. This 
function may be a hashing function. All or a portion of the result of the application of 
F(x) is then used as an offset to pointer 61 to select one among the several ports in set 
65 as a local destination for packet 53. For example, a hashing function may be used 
at process 57 to process a binary number that is the binary sum of the source and 
destination addresses of packet 53, producing a 32-bit binary result. By design, in this 
example, the most significant 4 bits of the processing result may be used as offset 59, 
added to pointer 61 , to select one of the destinations of set 63 for the packet. Four bits 
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provides an offset from 0 to 16 in numerical value. By default in the processing, if 
there are fewer than 16 different ports in set 65, some offsets values are mapped to 
more than one port. 

It will be apparent to the skilled artisan that every packet arriving having a 

5 common flow (same source and destination), will, by this scheme, be routed by the 
same egress port, and that design in mapping may also be used for load balancing. 

It will be apparent to the skilled artisan that the examples presented as 
embodiments of the present invention above are relatively simple, and in real routers 
there are many more interfaces and ports than those described herein. The simple 

10 schematics, however, presented herein are sufficient to describe the system and 
practice of the present invention. It is quite true that physical ports in routers may 
both transmit and receive packets, and inventors herein have described primarily one- 
way operation. This is a convenience only, and not a limitation the invention. The 
method may also be generalized to the case of MPLS packets for which hashing may 

15 be done on, for example, the top label or the top two labels, and for any case of such 
packets being routed and apportioned to equipment and elements of equipment having 
different traffic capacity. The invention must be accorded the breadth of the claims 
which follow: 
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What is claimed is: 

1 . A method for routing packets in a router to egress ports, the method comprising 
the steps of: 

5 (a) using a common characteristic of each packet, choosing a set of egress 

ports from a table of sets of ports associated with said characteristic; 

(b) processing any one or more addresses or labels of each packet using a 
common function, producing thereby a numerical processing result for each packet 
processed; and 

10 (c) using all or a portion of the numerical processing result to select a single 

egress port for each packet from among the egress ports of the set chosen in step (a). 

2. The method of claim 1 wherein, in step (a), the common characteristic used for a 
packet to select a set of egress ports is a destination address for the packet. 

15 

3. The method of claim 2 wherein the result of step (a) is a pointer to a first address 
of a sequence of addresses in a stored table wherein the set of egress ports is listed. 

4. The method of claim 3 wherein the result of step (b) is an offset, which is added, in 
20 step (c), to the address of the pointer to select a single egress port. 

5. The method of claim 1 wherein the addresses or labels processed in step (b) are a 
source/destination address pair, ensuring thereby that packets of common flow egress 
by a common egress port. 

25 

6. The method of claim 1 wherein the common function by which addresses or labels 
of packets are processed is a hashing function. 

7. The method of claim 6 wherein the hashing function result is a binary string, and 
30 wherein a default subset of the binary string is used to select an egress port in step (c). 
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8. The method of claim 1 wherein, in step (c), weighting is applied to egress ports 
based on different transmission capacities of the ports, such that packets having 

different processing results in step (b) may none-the-less be routed to a single, 
higher-capacity port, providing thereby load-balancing between egress ports. 

5 

9. The method of claim 1 wherein the data packets are MPLS packets, and in step (b), 
the processing is accomplished on one or more labels in the label stack of individual 
ones of the MPLS packets. 

10 10. The method of claim 1 wherein individual ones of the egress ports have different 
transmission capacity, the transmission capacity of a port having the lowest 
transmission capacity is considered a least denominator, ports having higher 
transmission capacity than the least denominator are assigned a whole number 
multiplier according to a capacity ratio, and the multipliers are used in the routing to 

1 5 ensure that ports having higher capacity are fully utilized. 

1 1 . A packet router, comprising: 

ingress and egress ports; and 
control circuitry for processing and routing packets; 
20 characterized in that the control circuitry uses a common characteristic of each 

packet to choose a set of egress ports from a table of sets of ports associated with said 
characteristic, processes one or more addresses or labels of each packet using a 
common function, producing thereby a numerical processing result for each packet 
processed, and uses all or a portion of the numerical processing result to select a 
25 single egress port for each packet from among the egress ports of the set chosen. 

12. The router of claim 1 1 wherein the common characteristic used for a packet to 
. select a set of egress ports is a destination address for the packet. 

30 13. The router of claim 12 wherein the result of table lookup is a pointer to a first 
address of a sequence of addresses in a stored table wherein the set of egress ports is 
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listed. 

14. The router of claim 13 wherein the processing by a common function produces 
an offset, which is added to the first address to select a single egress port. 

5 

15. The router of claim 1 1 wherein the addresses or labels processed are a 
source/destination address pair, ensuring thereby that packets of common flow egress 
by a common egress port. 

10 16. The router of claim 1 1 wherein the common function by which addresses or 
labels of packets are processed is a hashing function. 

17. The router of claim 16 wherein the hashing function result is a binary string, and 
wherein a default subset of the binary string is used to select an egress port. 

15 

18. The router of claim 1 1 wherein weighting is applied to egress ports based on 
different transmission capacities of the ports, such that packets having different 
processing results may none-the-less be routed to a single, higher-capacity port, 
providing thereby load-balancing between egress ports. 

20 

1 9. The router of claim 1 1 wherein the data packets are MPLS packets, and the 
processing is accomplished on one or more labels in the label stack of individual ones 
of the MPLS packets. 

25 20. The router of claim 1 1 wherein individual ones of the egress ports have different 
transmission capacity, the transmission capacity of a port having the lowest 
transmission capacity is considered a least denominator, ports having higher 
transmission capacity than the least denominator are assigned a whole number 
multiplier according to a capacity ratio, and the multipliers are used in the routing to 

30 ensure that ports having higher capacity are fully utilized. 
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21 . A method for routing packets in a packet router having a plurality of candidate 
egress ports for individual ones of the packets, comprising steps of: 

(a) mapping sets of candidate egress ports to a common characteristic of 
individual packets; 

5 (b) mapping individual ports in each set to a result of processing one or more 

addresses or labels of individual ones of packets to be routed by a common function; 

(c) selecting a set of candidate ports for each packet to be routed by consulting 
the common characteristic; and 

(d) selecting a single egress port from the selected set by the result of the 

10 processing by a common function the one or more addresses or labels of each packet. 



15 
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